1 link tagged with all of: language models + self rewriting
Click any tag below to further narrow down your results
Links
This arXiv paper claims an open 27B model can diagnose its own failures and edit its own weights, with no gradients and no training, and end up measurably more accurate. The authors frame it as "self-rewriting" and a possible step toward recursive self-improvement.
- The model's own edit raised its accuracy 6.6 points on problems it never saw during the edit.
- Across eight consecutive sessions it tested edits on practice problems and submitted only ones that worked, and accuracy only went up.
- Given a damaged copy of itself, it restored that copy to over 80% of original accuracy on unseen image tasks, without reading the original weights.